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) A motion compensating encoding apparatus 
adaptive to a motbn amount adaptively gener- 
ates motion-compensated pbcel values for per- 
forming differential pulse code nDodulation of 
pixel values of a current image even when a 
current image motion anrKXint to be nDotion- 
oompensated with respect to a reference image 
is beyond a predetenmined motion annount The 
motion compensation encoding apparatus in- 
cludes a global nrmtion e^imator (53) for 
generating a global nrK>tion vector representing 
spatial position difference between the refer- 
ence Image according to the pixel values stored 
In a first memory (17) and the current image 
according to the pixel values stored in a second 
memory (56), motion-compensating the refer- 
ence image on the basis of the generated global 
nrK)tion vector and storing the pixel values of the 
nnotion-compensated reference image, a local 
motion estimator (54) for generating a local 
motion vector according to comparison of the 
pixel values between a current video block 
which is formed by ttie pbcel values supplied 
from the second menKxy (56), and which has a 
size smaller than the current image and a 
search area formed by part of tiie pixel values 
stored in the global nrwtion estimator (53), a 
motion compensator (55) for receiving the local 
motion vector from the local motion estimator 
(54) and generating motion-compensated pixel 
values by using the pixel values stored in the 
global motion estimator (53) and the local mo- 
tion vector, and a unit (31) for generating a 
difference value between the respective pixel 
values of each image secondly output from the 
second memory (56) and the corresponding 
rrvotion-compensated pixel values output from 
the motion compensator (55). 
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EP0 689 359 A2 

The present invention relates to a motion compensation encxxling mettiod which is adaptive to an amount 
of nrotion and the apparatus thereof, and nwe particularly, though not exclusively, to a nrK)tion compensation 
encoding method for use in a differential pulse encoded video signal capable of adaptively performing a nK)tion 
compensation encoding operation even when an anwunt of motion between images is beyond a predetermined 
5 amount of motion. 

In a recent system, a video signal is usually encoded into digital data and then processed to Improve a 
quality of the picture. However, when the video signal is encoded into the digital data, an anrount of data be- 
comes considerably large. To solve such a problem, a conventional video encoding system utilizes a transfor- 
mation encoding method, a differential pulse code modulation (DPCM) method, a vector quantization method 

10 and a variable length coding (VLC) method, thereby removing redundancy data included in a digital video signal 
to reduce an amount of the total data. Referring to Figure 1 , a conventional motion Image encoder having a 
well-known structure will be described below. 

One frame digital video signal is reconstructed as M x N pixels. Pixel values of the reconstructed video 
blocks are stored in memory 10. The pixel values stored in memory 10 are applied to a motion estimator 18, 

15 a subtracter 31 and a ratk) controller 20. Motion estimator 18 uses pixel values of a current image supplied 
from menrary 10 and pbcel values of a reference image stored in a frame menrK>ry 1 7, to estimate an amount 
of motion with respect to the respective video blocks of the current image. Motbn estinratton performed on 
the basis of correlation between frames. Motion estimator 18 finds a reference video block having image in- 
formation nearly klentical to that of a current video block used for comparison in a search area which becomes 

20 a part of the reference image, to then generate a nrK>tion vector MV representing a spatial position difference 
between the current video block and the reference video block. A motion compensator 19 reads pixel values 
of the reference video block which is designated by motk)n vector MV produced by nmtion estimator 1 8, from 
frame memory 1 7. The read pixel values are output to subtracter 31 . Subtracter 31 subtracts a corresponding 
pixel value applied from nrrotion compensator 19 from a pixel value supplied from memory 1 0 for a differential 

25 pulse code modulation and outputs a differential pixel value obtained by substraction to a transfomner 11. A 
transformer 1 1 transforms spatial regk>n pixel values supplied from subtracter 31 into frequency region trans- 
form coeff rcient values. Transformer 11 uses one among a discrete cosine transform (DCT) method, a Walsh- 
Hadannard transform (WHT) method, a discrete Fourier transform (DFT) method or a discrete sine transform 
(DST) method, to perform a transform operation in units of a video block having M x N pixels. The transform 

30 coefficient values output from transformer 11 arequantized by a quantizer 12 to then be supplied to a variable- 
length coder 13 and an inverse quantizer 15. Quantizer 12 and inverse quantizer 15 quantizes and inverse- 
quantizes respectively the input data according to a quantization control signal Qss applied from ratk> controller 
20. 

Since technologies in connection with quantizer 12 and inverse quantizer 15 are well known, detailed de- 

35 scripttons thereof will be omitted. Variable-length coder 1 3 variable-length-codes the input data. A buffer 14 
temporarily stores the data output from variable-length coder 13 prior to being transmitted, and outputs a buffer 
fullness representing a storage state of buffer 14 to ratio controller 20. Ratk) controller 20 generates a control 
signal Qss for quantizatbn on the basis of the pixel values supplied from memory 1 0 and the buffer fullness 
applied from buffer 14. On the other hand an inverse transformer 1 6 performs an inverse transform of the trans- 

40 form coeff k:ient values applied from inverse quantizer 15 with respect to the transfonm by transformer 11 , to 
generate spatial regk>n pbcel values. An adder 32 adds pbcel values applied from motion compensator 19 and 
pixel values applied from inverse transformer 16, to then output the result to frame memory 1 7. Frame memory 
1 7 stores the pixel values applied from adder 32. The quantization control signal generated by ratio controller 
20, nrK)tion vector MV generated by motton estimator 1 8 and output data Vc of buffer 14 are supplied to a video 

45 decoder shown in Figure 2. Switches 33 and 34 are used for reducing the difference between an image prior 
to being encoded by differential pulse code nxxlulation in the motion pfeture encoder shown in Figure 1 and 
an image after decoding in the deccxJer shown in Figure 2. 

In the nration decoder of Figure 2, variable-length decoder 21 variable-length-decodes data Vc output from 
buffer 14. An inverse quantizer 22 and in inverse transformer 23 perform the same function as those of inverse 

50 quantizer 15 and inverse transformer 16 of Figure 1 , respectively. Motion compensator 24 reads pbcel values 
from frame memory 25 corresponding to motk>n vector MV to supply the read pbcel values to an adder 26. Adder 
26 adds the output data of nDotion compensator 24 to the output data of inverse transfonmer 23. to output the 
result to a display and frame memory 25. A switch 27 is used for the same purpose as those of above switches 
33 and 34. 

55 Since the rTK>tk>n image encoder shown in Figure 1 uses a search area composed of the number of pixels 
smaller than one frame to find a reference video btock having the same inDage information as that of a current 
vkJeo block, a reference video block having the same image information as that of the current video block does 
not exist in a given search area, in case of a fast moving picture or a whole faning picture such as sports. The 
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Figure 1 motion image encoder does not perform a non-intracoding operation whfch obtains a difference value 
between image frames by using differential pulse code modulation with respect to the current video block, but 
performs an intracoding operation. Accordingly, an anrKXjnt of bits of the encoded data becomes large. Such 
a problem lowers a total quality of picture and heightens a probability of occurrence of an overflow in buffer 
14. in a system by a predetenmined data standard which uses a proper combination of an intracoding and a 
non-intracoding. 

It is an aim of preferred embodiments of the present invention to provide a motion compensation encoding 
method which estimates an amount of motion with respect to a video block to be nrK)tion-compensatk)n-en- 
coded and is adaptive to an amount of PDOtion for generating the motfon-compensated data, in which a global 
motion vector representing displacement between the frannes is generated by altering a motton estimation 
range into a whole frame in case of an image having a large anraunt of motion between frames, and using 
data of the frame motion-compensated by the generated global motion vector. 

It is another aim of preferred embodiments of the present invention to provide an apparatus embodying 
the aforementk)ned method. 

It is still another aim of preferred embodiments of the present invention to provide a motk>n compensation 
encoding apparatus which is adaptive to an amount of motton for generating nriotion-compensated data by gen- 
erating a reference image which is obtained by compensating spatial position difference between an image 
to be motion-compensated and an innage which becomes a reference of motion compensation. 

According to a first aspect of the present inventfon, there is provided a motk>n compensation encoding 
apparatus for use in an image encoder for performing differential pulse code modulation by using pixel values 
of a current image and motk)n-compensated pbcel values, the motion compensation encoder comprising: 
a first memory for storing pixel values of a reference image; 

a second menrwry for storing pixel values with respect to a plural ity of images, and repetitively outputting 
the stored pbcel values of each image one-f ranne by one-frame at least twice; 

global motion estinnation means for generating a gk)bal motton vector representing spatial position dif- 
ference between the reference image according to the pbcel values stored in the first memory and the current 
Image according to the pbcel values stored in the second nnemory, nrration-compensating the reference image 
on the basis of the generated global motion vector and storing the pbcel values of the nnotiorvcompensated 
reference image; 

local motion estimatton means for generating a local motion vector according to comparison of the pbcel 
values between a cun-ent video block which is formed by the pixel values supplied from the second memory, 
and whteh has a size snnaller than the current image and a search area formed by part of the pixel values stored 
in the global motion estimation means; 

motton compensation means for receiving the tocai motion vector from the local motion estirr^tion - 
means and generating motfon-compensated pbcel values by using the pbcel values stored in the global motion 
estimation means and the local motfon vecton and 

means for generating a difference value between the respecth^e pbcel values of each image secondly 
output from the second memory and the corresponding motion-compensated pbcel values output from the mo- 
tton compensatfon nrteans. 

Suitably, said global motfon estirr>ator generates said local nrK>tfon vector on the basis of a mean absolute 
error value according to pbcel difference values between a plurality of a respectively moved current image ob- 
tained by ntovement within the motion estimation range and the reference image. 

Suitably, safo global nation estinDator generates said local motfon vector on the basis of a mean square 
error value according to pbcel difference values between a plurality of a respectively nrwved current image ob- 
tained by nDovement within the nrwtion estiniation range and the reference image. 

According to a second aspect of the present inventfon, there is provided a motton compensation encoding 
apparatus for use in an image encoder for performing differential pulse code nrKxlulatton by using pbcel values 
of a current image and motfon-compensated pbcel values, the motton compensation encoder comprising: 

a first memory for storing pixel values of a reference image; 

a second memory for storing pbcel values with respect to a plurality of images, outputting the stored 
pixel values of each image one-frame by one-f ran^, and outputting again the pbcel values of each image output 
one-frame by one-frame once or twice more on the basis of a first control signal; 

motion discrimination means, coupled to receive the firstly output one-frame pixel values anrwng the 
duplicate pixel values of the same image outputfrom the second memory, for discriminating whether an amount 
of motion of the current image according to the pbcel values supplied from the second mennory with respect 
to the reference image according to the pbcel values stored in the first memory, is beyond a predetermined 
amount of motion, and generating first and second control signals according to the discrimination result; 

global nrration estin^tion means for generating a gtobal motton vector representing spatial position dif- 
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ference between the reference image according to the pixel values stored in the first memory and the current 
Image according to the pixel values stored in the second menK)ry, and storing the pixel values of the nrK)tion- 
compensated reference image on the basis of the generated global motion vector; 

local nrwtion estimation means for discriminating whether the motion-compensated reference image is 
5 stored in the global nrrotion estimation means, and generating one of a first local motion vector according to 
comparison of the pixel values between a current video block which is fontted by the pixel values supplied from 
the second menriory, and which has a size smaller than the current inr^ge and a first search area fonned by 
part of the pixel values stored in the first nronKM-y, and a second local motion vector according to comparison 
of the pixel values between the current video block and a second search area tonmed by part of the pbcel values 
10 stored in the global motion estimation means, on the basis of the discrimination result; 

switching nneans for outputting the pixel values supplied from the second memory to the local motion 
estimation means if the second control signal generated int he motion discrimination means represents that 
the current image motion anKHjnt is not beyond the predetermined motion amount, outputting one-frame pixel 
values among the pixel values oft eh same innage supplied from the second memory, if the second control 
15 signal represents that the current image motion amount is beyond the predetermined rTK>tion amount, and out- 
putting the following one-frame pbcel values to the local motion estimatbn means; 

motion compensation means for generating motion-compensated pixel values by using the pixel values 
stored in the first memory and the first local nrK>tion vector if the first local nrK)tk>n vector is applied from the 
local motion estimation means, and generating motk)n-compensated pixel values stored in the global nration 
20 estimation means and the second local motion vector. If the second local nration vec^r is applied from the 
local motion estimatton means; and 

means for generating a difference value between the respective pixel values of each image output from 
the second menK>ry and the corresponding nK>tion-compensated pixel values outputfrom the motion compen- 
sation means. 

25 Suitably, said second menrmry outputs the pixel values of the current image one-frame by one-frame twice 

if the first control signal represents that the current image motion amount is beyond the predetermined nrwtion 
anxMjnt, while sakj second memory outputs the pixel values of the current innage of only one frame if the first 
control signal represents that the fomner is not t>eyond the latter. 

Suitably, said nrrotion discriminator generates the first control signal according to a result whether the first 
30 reference video block having the same image information as that of the current video block exists in the first 
search area corresponding to the current video block. 

Suitably, said motton discriminator discriminates whether the first reference video block having the sanrte 
image information with respect to a plurality of the current vWeo block exists in the current image. 

Suitably, saki global nriotion estimator generates said first local nrtotton vector on the basis of a nnean ab- 
35 solute error value according to pixel difference values between a plurality of a respectively moved current im- 
age obtained by movement within the motton estimation range and the reference image. 

Suitably, said global motbn estimator generates sakl first local motion vector on the basis of a mean square 
error value according to pixel difference values between a plurality of a respectively nwved current image ob- 
tained by movement within the nrK>tton estimation range and the reference image. 
40 Suitably, said local motion estimator generates sakj first local motion vector if the n>otion-compensated 

reference image is not stored in sakJ global motion estimator, while the former generates sakl second local 
nootion vector if the nrK)tion-compensated reference image is stored in sakJ latter. 

According to a third aspect of the present inventton, there is provided a motion compensatfon encoding 
method for use in an image encoder for performing differential pulse code modulatton by using pixel values 
45 of a current image and motion-compensated pixel values, the motk)n compensation encoding nrmthod com- 
prising the steps of: 

a) storing pixel values of a reference image for nr>otk)n compensatton; 

b) storing pixel values of the current image; 

c) discriminating whether an anruMint of nrK>tk>n of the current image to be nfK>tion-compensated is beyond 
50 a predetermined anxMjnt of nrK>tton on the basis of all the pixel values stored in steps a) and b); 

d) generating a global motton vector representing spatial position difference of the current image of the 
pixel values stored in step b) with respect to the reference image of the pixel values stored in step a), if a 
discriminatton result of step c) represents that the current image motion amount is beyond the predeter- 
mined motion anrK>unt; 

55 e) nwtion-compensating the reference image corresponding to the pixel value stored in step a) to store 
the pixel values of the n[x>tion-compensated reference image; 

f) generating a second local rration vector on the basis of comparison of pixel values between a first video 
block and a second search area formed by part of the pixel values stored in step e); 
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g) generating motion-compensated pixel values by using the second local motion vector generated in step 
f) and the corresponding pixel values stored in step e); and 

h) generating a difference value between the respective pixel values of the current image stored in step 
b) and the corresponding pixel values of the motion-compensated reference image generated in step g). 
Suitably, said method further comprises the steps of: 

i) generating a first local nrration vector on the basis of comparfeon of the pixel values between the first 
video block which is formed by the pbcel values stored in step b) and having a smaller size than that of the 
current image and a first search area formed by a part of the pixel values stored in step a); 

j) generating the motion-compensated pbcel values using the first local motion vector generated in step i) 
and the corresponding pbcel values stored in step a); and 

k) generating a difference value between the respective pbcel values of the current image stored in step 
b) and the corresponding pbcel values of the motion-compensated reference Image generated in step j). 
wherein a discriminatron result of step c) represents that the current image motton anrwunt is not beyond 
the predetermined motion anxnjnt 

Suitably, said step c) comprises the sub-steps of: 

c1) forming the first search area for motion estimatfon of the current video block, and including the current 
video block having a part of the current image pixel values and a part of the pbcel values stored in step a); 
c2) discriminating whether the reference video block having the san>e image information as that of the cur- 
rent video block exists in the first search area on the basis of comparison of the image information between 
the current vkleo block pbcel values formed in sub^tep d) and the corresponding blocks which exist in the 
first search area and having the same number of pbcels as that of the current video block; and 

discriminating whether the current image motion amount is beyond the predetermined motion amount 
on the basis of the discriminatk>n result of sub-step c2). 

Suitably, said sub-step c2) further comprises the sub-step of discriminating whether the first reference vid- 
eo block having the same image information with respect to a plurality of the current video blocks exists in the 
current image. 

Suitably, said step d) further comprises the sub-step of d1) generating the global motion vector on the basis 
of a mean absolute error value according to pbcel difference values between a plurality of a respectively moved 
current image obtained by nnovement of the current image within the predetermined nriotnn estimation range 
and the reference image. 

Suitably, sub-step d1) comprises the sub-step of da1) calculating the mean absolute error value of the pbcel 
difference values between one current image by movement using the following equation and the reference 
image. 



W H 



-x_rang s k s x_rang-l, 

-y_rang sis y_rang-l (1) . 

in which Ycu,(m, n) represents the (m, n)"* pbcel value in the current image, and YreKm, n) represents the 
(m, np pbcel value in the reference image, characters W and H represent the number of horizontal and vertical 
pbcels, respectively, and expressk>ns x_rang and y_rang represent a nwvement range of the current image 
with respect to the reference image in the horizontal and vertical directions, respectively. 

Suitably, step d) further comprises the sub-step of 62) generating the global motion vector on the basis 
of a mean square error value according to pbcel difference values between a plurality of a respectively moved 
current image obtained by nrmvement of the current image within the predetermined nrK>tion estimation range 
and the reference image. 

Suitably, said sub-step d2) comprises the sub-step of da2) calculating the mean square error value of the 
pbcel difference values between one current innage by movement using the following equation and the refer- 
ence image, 
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MV(k, 1) = min 



m=0 n=0 



-x_rang 
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s k s x_rang-l, 
sis y_rang-l 



(2) . 



in which Y^^m, n) represents the (m, n)^ pixel value in the current image, and Y^^m, n) represents the 
(m, n)*** pixel value in the reference image, characters W and H represent the numl)er of horizontal and vertical 
pbcels, respectively, and expressions x_rang and y_rang represent a nrKJvement range of the current Image 
with respect to the reference image in the horizontal and vertical directions, respectively. 

Preferred eml)odiments of the present invention are described, by way of example only, with reference to 
the drawings, wherein: 

Figure 1 is a block diagram showing a conventional image encoding system. 

Figure 2 is a t)lock diagram showing a conventional innage decoding system. 

Figure 3 is a block diagram showing a woWon compensating encoding apparatus according to a preferred 
embodiment of the present invention. 

Figures 4Aand 4B show a motion compensation encoding nvethod which is adaptive to an amount of motion 
according to the present invention. 

A preferred embodiment of the present invention will be described below in more detail with reference to 
the accompanying drawings Figures 3, 4A and 4B. 

Figure 3 shows a motion compensatk>n encoder according tD a preferred embodiment of the present in- 
vention. In Figure 3, the like elements to Figure 1 use the like reference numerals thereto and the detailed 
description thereof will be omitted. 

Aconstructk>n and operation of the Figure 3 apparatus will be described below in connectfon with the pres- 
ent invention. 

A memory 56 stores pixel values of a plurality of i mages. Memory 56 outputs the pixel values of a prevtous 
image among the stored pixel values to a ratio controller 20 and a subtracter 31. and outputs the pbcel values 
of a current image to motfon dfecriminator 51 . Subtracter 31 subtracts the corresponding pbcel values supplied 
from motion compensator 55 from the respective pbcel values of the previous image supplied from nr>emory 
31 and outputs a difference value to a transformer 11 . 

On the other hand, motk>n estimator 51 receives the pbcel values of the reference image stored in a frame 
menruH-y 17 if the pbcel values of the current image is supplied from menK>ry 56 and discriminates an amount 
of nrK>tion of the current image with respect to the reference image. To discriminate the amount of motion of 
the current inrrage with respect to the reference image, nwtion discriminator 51 discriminates whether a first 
reference video btock having the same image information as that of a current video block which becomes a 
part of the current image exists in a first search area with respect to one or more current vWeo blocks. Motion 
discriminator 51 generates a first control signal CTL1 repwesenting whether motion estimation of the current 
image is possible using the pixel values of the reference image on the basis of the detection result. Motion 
discriminator 51 generates a second control signal CTL2 on the basis of the above discrimination result If first 
control signal CTL1 represents that the motion estimation of the current image is possible using the pixel values 
of the reference image, menK)ry 56 supplies the pbcel values of the current image to a switch 52. Memory 56 
supplies the pbcel values of the current image again to a subtracter 31 after all the pbcel values of the cun^nt 
image are supplied to switch 52. Switch 52 supplies the pbcel values of the current image supplied via an input 
end C from nrtemory 56 to a \oca\ nrK>tk>n estinuitor 54 via a first output end A, according to the applied second 
control signal CTL2. Local rrK>tion estimator 54 discriminates whether the pbcel values of the compensated ref- 
erence image are stored in global motion estimator 53. If the pbcel values of the compensated reference image 
are not stored in gk)bal motion estimator 53 as a discariminatfon result, local motion estimator 54 uses the pbcel 
values of the reference image stored in frame memory 17 and the pbcel values of the current image applied 
via switch 52, and generates a first local motk>n vector LMV1 with respect to a cxjrrent video block. 

The generation of the first local motk)n vector LMV1 will be described below with reference to Figure 4A. 
In Figure 4A. first local motion vector LMV1 is determined on the basis of the current vkleo block within the 
current image and the first search area within the reference image. Here, the first search area has a smaller 
number of pbcels than that of the reference image, and has a position on an image corresponding to the current 
vkleo block. In Figure 4A, the current vkJeo block is represented as a hatched rectangular shape, and the first 
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reference video block having the same image infomiation as that of the current video block is represented as 
a hatched rectangular shape. Local motion estin^tor 54 compares a corresponding block having the same 
number of pixels as that of the current video block and which is located on the left-upper end in the first search 
area and all blocks which are obtained by nK>ving the corresponding block one-pbcel by one-pbcel to the right 
5 direction and/or to the down directfon with the cun^nt vWeo block. A method used for comparison is a well- 
known mean absolute error (MAE) method or mean square error (MSE) method. If the first reference video 
btock having the least difference value from the current video block is determined by comparison of the pixel 
values of the MAE or MSE, local nfX)tion estimator 54 generates a first local motion vector LMV1 representing 
spatial position difference between the first reference video block and the current vWeo block. First local motion 

10 vector l^V1 is produced with respect to the respecth^e current video blocks and the produced first motion vec- 
tor LMV1 is supplied to motion compensator 55. 

Motion compensator 55 discriminates that the pixel values of the compensated reference image are not 
stored in global nrratfon estimator 53. if first nrwtion vector LMV1 is applied from motion estimator 54. Based 
on such discrimination, motion compensator 55 generates the nix>tk>n-compensated pixel values according to 

IS the pixel values of the reference image stored in f rante memory 1 7 and the first tocal motion vector LM V1 gen- 
erated in motion estimator 54. Subtracter 31 subtracts the corresponding pbcel values supplied from motion 
compensator 55 from the respective pixel values of the current image supplied from menrwry 56 and outputs 
the difference value obtained by subtractbn to transformer 11 . The pixel values output from nrratfon compen- 
sator 55 are also supplied to an adder 32, by which is added to the date output from inverse transformer 16. 

20 The pixel values obtained by adder 32 are stored in frame rnemory 1 7 and used as the pixel values of the ref- 
erence image for motion-compensating the following image. 

If first control signal CTL1 generated in motion discriminator 51 represents that motbn estimation of the 
current image is not possible using the pixel values of the reference image, nDenrary 56 repetitively supplies 
the pbcel values of the current inr>age one-frame by one-frame twice to switeh 52. After memory 56 repetitively 

25 supplies the pbcel values of the current image twice to switeh 52, the pixel values of the current image are also 
supplied to subtracter 31 . Switeh 52 supplies the pbcel values of firstly input one-frame current image among 
the pixel values of the two-frame current image supplied via input end C from memory 56 according to the 
applied second control signal CTL2, via a second output end B to local motion estimator 54. Then, switch 52 
supplies the pbcel values of the secondly applied current image via first output end A to local motton estimater 

30 54. Local motion estimator 54 does not generate a local motion vector during the time when the pbcel values 
of the current image are not supplied via switeh 52. Subtracter 31 does not operate as well since the pbcel values 
of the current image from memory 56 and the motion-compensated pbcel values from nrrotion (x>mpensator 55 
are not supplied thereto. 

Global motion estimator 53 generates a global motion vector GMV representing spatial position difference 
35 of the current image with respect to the reference image by using all the pbcel values of the current image ap- 
plied from second output end B of switeh 52 and all the pbcel values of the reference image stored in f ranne 
menr>ory 17. Global motion estimator 53 uses one among the following equations (1) according to the MAE 
method or following equation (2) according to the MSE method, to generate global motbn vector GMV. The 
relationship between the reference image and the compensated reference image is conceptually shown in Fig- 
40 ure 4B. As can be seen from Figure 4B. global motton vector GMV represents the spatial positbn difference 
of the current image with respect to the reference image. 
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Here, Ycur(m. n) represents the (m, n)^ pixel value in the current innage, and Yre^m, n) represents the (m, 
nyh pixel value in the reference image. Characters W and H represent the number of horizontal and vertical 
pixels, respectively. Expression x_rang and y_rang represent a movement range of the current image with re- 
spect to the reference inrage in the horizontal and vertical directions, respectively. That is, the current image 

15 can have a position with respect to the reference image within the range from -x_rang to x_range-1 of the ref- 
erence image in the horizontal direction. This is also same as that in the vertical directfon. As shown in Figure 
4B, global motion estimator 53 recefves and stores the pbcel values of the compensated reference image having 
a reference position moved from frame menK>ry 1 7, by moving a position of the reference image by global mo- 
tion vector GMV. Actually, in case of pbcels to be added to a newly compensated reference frame by movement 

20 of the reference frame aniong the pixel values of the compensated reference frame stored in global nrK>tion 
estimator 53, all pixel values are established into any one of the sanr>e values. Such a value can be set to a 
specific value of "0" or "255" in case of a pixel value representing 256 gradation. 

After global nation vector GMV and the compensated reference image have been completely determined 
by global nrwtion estimator 53, the pbcel values of the current image supplied from memory 56 are supplied 

25 via switch 52 to local motion estimator 54. Local nnotion estimator 54 determines whether the pixel values of 
the compensated reference image are stored in global motion estimator 53, if the pixel values of the current 
image are applied via first output end A of switch 52. If global nnotion estimator 53 stores the pbcel values of 
the compensated reference image according to the discrimination result, local motion estinnator 54 uses the 
pixel values of the compensated reference innage stored in global nrwtion estinnator 53 and the pbcel values of 

30 the current image applied via switch 52, to generate a second local nmtion vector LMV2 with respect to the 
current video block. Since a generation process of second local motion vector LMV2 in Icx^l motion estimator 
54 Is similar to that of motion estimator 18 which determines the first reference video block with respect to the 
current vkJeo block by using the pixel values stored in frame menK>ry 17, the generation process thereof will 
be omitted. 

35 Local nrKJtton estimator 54 compares the pbcel values of the current video block with the pbcel values in a 
second search area of the compensated reference frame, and determines a second reference video block in 
the second search area having the same image information as that of the current video block. Here, the second 
search area has a position which is moved by a value of global motton vector GMV from the first search area 
as shown in Figure 4B. and has a position corresponding to the current vkJeo block used tor comparison within 

40 the compensated reference image as well. Local motk>n estinnator 54 generates second tocal motton vector 
LMV2 representing spatial position difference between the current video block and the second reference video 
btock, if the second reference video block is detennined. The generated second local motion vector LMV2 is 
supplied to motton compensator 55. 

Motion compensator 55 uses the pixel values of the compensated reference image stored in global nrrotion 

45 estimator 53 and the second tocal nrK>tion vector LMV2 to obtain the motton-compensated pbcel values with 
respect to the current vkJeo bAock if the second local motion vector LMV2 is applied thereto, and then outputs 
the obtained pbcel values to subtracter 31 and adder 32. Subtracter 31 subtracts the motion-compensated pbcel 
values supplied from nrK>tton compensator 55 from the pixel values of the current image supplied from niennory 
56. Thereafter, since operatton of the Figure 3 apparatus is the same as the nwtion compensation operation 

50 using the first local nrratnn vector LMVI. the detailed description thereof will be omitted. The global motion vec- 
tor GMV and local nK)tion vector LMVI or LMV2 generated in the Figure 3 apparatus are transmitted to a de- 
coder (not shown) for decoding the motton-compensated encoded image. 

In the case of the above-described embodiment, the apparatus of Figure 3 operates on the basis of the 
control signals according to the discriminatton of nK>tton discriminator 51. It is. however, possible to provide 

55 other variations which are obtained by removing nrwtton discriminator 51 and switch 52. The nrwdif led embodi- 
ment will be briefly described below referring to Figure 3. 

If menfK>ry 56 outputs the pbcel values of the current image, global nrKjtton estimator 53 generates a global 
motion vector of the current image with respect to the reference image in the sanrte manner as that described 
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referring to F^ure 3. Global motion estlnrator 53 uses the generated global motion vector, motion-compensates 
the reference image, and stores the pixel values of the motion-compensated reference image. 

Motion estimator 54 generates a local motion vector on the basis of the motion-compensated reference 
image stored in global motion estimator 53 and the pixel values of the current image applied from memory 
56. Motion compensator 54 uses the local motion vector and the pixel values stored in global motion estimator 
53, to generate the nrK>tion-compensated pixel values. Thus, nfK>tion compensator 54 can generate the motion- 
compensated pixel values properly as well when an annount of nrrotion of the current image with respect to the 
reference image is beyond a predetermined motion amount. 

As described above, the motion compensation encoder adaptive to an anrKMjnt of motion according to the 
present invention can determine a motion vector with respect to the respective video blocks in the current im- 
age, even when nr>otion vectors with respect to the respective video blocks in the current innage cannot deter- 
mine using the search area determined in the reference image. Thus, a problem of increasing an amount of 
the transmission data occunrfng in the conventional motion compensatk>n encoding system which performs 
an intracoding operation because of no determinatfon of the nwtion vector with respect to an image having a 
large amount of motion, can be solved. 

While only certain embodiments of the Invention have been specifically described herein, it will be appa- 
rent that numerous nKxiificatk>ns may be made thereto without departing from the spirit and scope of the in- 
vention. 

The reader's attentton is directed to all papers and documents which are filed concurrently with or prevk>us 
to this specif icatk>n in connection with this application and which are open to public Inspection with this spec- 
ification, and the contents of all such papers and documents are Incorporated herein by reference. 

All of the features disclosed in this specif icatnn (including any accompanying claims, abstract and draw^ 
ings), and/or all of the steps of any method or process so disclosed, may be combined in any combination, 
except combinations where at least some of such features and/or steps are mutually exclusive. 

Each feature diseased in this specification (Including any accompanying claims, abstract and drawings), 
may be replaced by alternative features serving the same, equivalent or similar purpose, unless expressly stat- 
ed otherwise. Thus, unless expressly stated otherwise, each feature disclosed is one example only of a generic 
series of equivalent or similar features. 

The Invention Is not restricted to the details of the foregoing embodiment(s). The Invention extends to any 
novel one, or any novel combinatfon, of the features disclosed in this specif Icatfon (including any accompa- 
nying claims, abstract and drawings), or to any novel one, or any novel combination, of the steps of any method 
or process so disclosed. 



Claims 

1 . A nrwtion compensatk>n encoding apparatus for use In an image encoder for performing differential pulse 
code modulation by using pixel values of a current image and motton-compensated pixel values, said mo- 
tion compensatk>n encoder comprising: 

a first menrK)ry (1 7) for storing pixel values of a reference image; 

a second memory (56) for storing pixel values with respect to a plurality of images, and repetitively 
outputting the stored pixel values of each Image one-frame by one-frame at least twice; 

global nK>tk>n estimation means (53) for generating a global motion vector representing spatial pos- 
ition difference between the reference Inr^ge according to the pbcel values stored in the first memory (17) 
and the current Image according to the pixel values stored in the second memory (56), motion-compen- 
sating the reference image on the basis of the generated global nrK>tlon vector and storing the pbcel values 
of the nrx>tk)n-compensated reference Image; 

local motion estimatk>n means (54) for generating a local PDOton vector according to comparison 
of the pixel values between a current video block which is formed by the pixel values supplied from the 
second memory (56), and which has a size smaller than the current image and a search area formed by 
part of the pbcel values stored in the global nration estimatton means (53); 

motion compensation means (55) for receiving the local nK>tlon vector from the local motion estl- 
matfon means (54) and generating nriotlon-compensated pbcel values by using the pixel values stored in 
the global motion estimation means (53) and the local motion vector; and 

means (31) for generating a difference value between the respective pixel values of each image 
secondly output from the second menrK>ry (56) and the corresponding nrrotfon-compensated pixel values 
output from the nwtfon compensatk)n means (55). 
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A motion compensation encoding apparatus according to daim 1, wherein said global nrwtion estimator 
(53) generates said local motion vector on the basis of a mean absolute error value according to pixel 
difference values between a plurality of a respectively moved current Image obtained by movement within 
the motion estimatbn range and the reference inriage. 

A motion compensation encoding apparatus according to daim 1, wherein said global motion estimator 
(53) generates said local motion vector on the basis of a mean square errtw value according to pixel dif- 
ference values between a plurality of a respectively moved current image obtained by movement within 
the motion estimation range and the reference image. 

A motbn compensation encoding apparatus for use in an image encoder for performing differential pulse 
code modulation by using pbcel values of a current image and motion-compensated pixel values, said mo- 
tion compensation encoder comprising: 

a first memory (17) for storing pixel values of a reference image; 

a second memory (56) for storing pbcel values with respect to a plurality of images, outputting the 
stored pbcel values of each image one-frame by one-frame, and outputting again the pbcel values of each 
image output one-frame by one-frame once or twice more on the basis of a first control signal; 

motion discrimination means (51), coupled to receive the firstly output one-frame pbcel values 
among the duplicate pbcel values of the sanrve image output from the second memory (56), for discrimin- 
ating whether an amount of nrK>tion of the current image according to the pixel values supplied from the 
second memory (56) with respect to the reference Image according to the pbcel values stored in the first 
menwry (17). is beyond a predetermined amount of motion, and generating first and second control sig- 
nals according to the discrimination result; 

global motion estimation nr^ns (53) for generating a global motion vector representing spatial pos- 
ition difference between the reference image according to the pbcel values stored in the first memory (1 7) 
and the current image according to the pbcel values stored in the second memory (56), and storing the 
pbcel values of the motion-compensated reference image on the basts of the generated global motion vec- 
tor; 

local motion estimation means (54) for discriminating whether the motion-compensated reference 
Image is stored in the global nrK>tion estimation means (53). and generating one of a first local motion 
vector according to comparison of the pbcel values between a current video block which is formed by the 
pbcel values supplied from the second memory (56). and which has a size smaller than the cun^nt image 
and a firet search area formed by part of the pixel values stored in the first memory (17). and a second 
local motion vector according to comparison of the pbcel values between the current video block and a 
second search area formed by part of the pbc^ values stored in the global nrwtfon estimation means (53). 
on the basis of the discrimination result; 

switching means (52) for outputting the pixel values supplied from the second memory (56) to the 
local nrwtfon estimatfon means (54) if the second control signal generated in the motkwi discriminatkwi means 
(51) represents that the current image nrtotkm anrKXjnt is not beyond the predetermined motxxi amount, out- 
putting one-f ranne pbcel values anDong the pixel values of the same image supplied from the second memory 
(56), if the second control signal represents that the current image motk>n amount is beyond the predeter- 
mined nrwtion amount, and outputting the following one-frame pbcel values to the local motfon estimation 
means (54); 

motion compensation means (55) for generating motbn-compensated pbcel values by using the pbc- 
el values stored in the first menrwry (17) and the f ffst local nrwtion vector if the first local motion vector is 
applied from the local motion estinnation n>eans (54), and generating motk>n-compensated pixel values 
stored in the global nrK>tion estimatbn means (53) and the second local motion vector, if the second local 
nrK>tk>n vector is applied from the local motbn estimation means (54); and 

means (31) for generating a difference value between the respective pbcel values of each image 
output from the second mennory (56) and the corresponding motbn-compensated pbcel values output from 
the motbn compensatbn means (55). 

A motbn compensatbn encoding apparatus according to claim 4, wherein said second memory (56) out- 
puts the pbcel values of the current image one-frame by one-frame twice if the first control signal repre- 
sents that the current image motbn amount is beyond the predetermined motbn amount, while said sec- 
ond menDory (56) outputs the pbcel values of the current image of only one frame if the first control signal 
represents that the former is not beyond the latter. 
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A motion compensation encoding apparatus according to claim 4 or claim 5, wherein said motion discrim- 
inator generates the first control signal according to a result whether the first reference video block having 
the sanr»e image information as that of the current video block exists in the first search area corresponding 
to the current video block. 

A motfon compensation encoding apparatus according to any of daims 4 to 6, wherein said motion dis- 
criminator discriminates whether the first reference vkleo btock having the same image information with 
respect to a plurality of the current video block exists in the current image. 

A motfon compensation encoding apparatus according to any of claims 4 to 7, wherein said global motion 
estimator (53) generates said first local motion vector on the basis of a mean absolute error value ac- 
cording to pixel difference values between a plurality of a respectively moved current Image obtained by 
movement within the motfon estimation range and the reference image. 

A motion compensation encoding apparatus according to any of claims 4 to 7, wherein said global motion 
estimator (53) generates said first local motion vector on the basis of a mean square error value according 
to pixel difference values between a plurality of a respectively nrK>ved current image obtained by move- 
ment within the motion estimation range and the reference Image. 

A motfon compensation encoding apparatus according to any of claims 4 to 9, wherein said local motion 
estimator (54) generates said first local motfon vector if the motfon-compensated reference Image is not 
stored in saki global motion estimator (53), while the former generates said second local motion vector 
if the motion-compensated reference image is stored in said latter. 

A motion compensation encoding method for use in an image encoder for performing differential pulse 
code HDodulation by using pixel values of a current image and motion compensated pixel values, said mo- 
tion compensatfon encoding method comprising the steps of: 

a) storing pixel values of a reference image for motion compensatfon; 

b) storing pbcel values of the current Image; 

c) discriminating whether an anrount of motion of the current image to be motfon-compensated Is be- 
yond a predetermined amount of motion on the basis of all the pixel values stored In steps a) and b); 

d) generating a global nDotfon vector representing spatial posltfon difference of the current image of 
the pixel values stored in step b) with respect to the reference image of the pixel values stored in step 

a) . If a discrimination result of step c) represents that the current image motfon amount Is beyond the 
predetermined motion aoDount; 

e) nK>tion compensating the reference image corresponding to the pixel values stored in step a) to store 
the pixel values of the motion-compensated reference image; 

f) generating a second local nrrotfon vector on the basis of comparison of pixel values between a f iret 
video block and a second search area formed by part of the pixel values stored In step e); 

g) generating motfon-compensated pixel values by using the second local motion vector generated in 
step f) and the corresponding pbcel values stCH^ In step e); and 

h) generating a difference value between the respective pixel values of the current image stored in 
step b) and the corresponding pixel values of the motfon-compensated reference image generated In 
step g). 

A motion compensatfon encoding method according to claim 11, further comprising the steps of: 

I) generating a first local nrnrtfon vector on the basis of comparison of the pbcel values between the first 
video block which is formed by the pbcel values stored in step b) and having a smaller size than that of 
the current image and a first search area farmed by a part of the pixel values stored In step a); 
j) generating the nrwtion-compensated pixel values using the first local motion vector generated in step 
I) and the corresponding pbcel values stored in step a); and 

k) generating a difference value between the respective pixel values of the current image stored in step 

b) and the corresponding pbcel values of the nration-compensated reference image generated in step 
j). 

wherein a discrimination result of step c) represents that the cun^ent image motion anwunt Is not 
beyond the predetermined nDotion annount 

The motion compensatfon encoding method according to claim 11 or daim 12, wherein said step c) com- 
prises the sut>-steps of: 



11 



EP 0 689 359 A2 



c1) forming the first search area for motion estimatbn of the cunnent video block, and including the cur- 
rent video block having a part of the cun^nt image pixel values and a part of the pbcel values stored In 
step a); 

c2) discriminating whether the reference video block having the same image information as that of the 
current video block exists in the first search area on the basis of comparison of the Image information 
between the current video block pbcel values formed in sub-step cl) and the corresponding blocks which 
exist in the first search area and having the same number of pixels as that of the current vkleo block; 
and 

discriminating whether the current image motion amount is beyond the predetermined motion 
amount on the basis of the discrimination result of sub-step c2). 

14. A motion compensatk>n encoding method according to daim 1 3, wherein said sub-step c2) further com- 
prises the sub-step of discriminating whether the first reference video block having the same Image in- 
formatfon with respect to a plurality of the current video blocks exists in the current image. 

15. A motion compensation encoding PDethod according to any of claims 11 to 14, wherein said step d) further 
comprises the sub-step of dl) generating the global nriotion vector o the basis of a mean absolute error 
value according to pixel difference values between a plurality of a respectively moved current image ob- 
tained by movement of the current image within the predetermined nrK)tion estlmatnn range and the ref- 
erence image. 

1 6. A nwtfon compensation encoding method according to daim 1 5, wherein sakj sub-step dl) comprises the 
sub-step of dal) calculating the mean absolute error value of the pbcel difference values between one cur- 
rent image by nfx>vement using the following equation and the reference image, 



H 



MV(k, 2) =min ^^lycur^^^^^ri^ ^)-yrefi^'n'> 



-x_rang s k s x_rang-l, 
-y_rang sis y_rang-l 



In which Ycur(m, n) represents the (m, vif* pbcel value in the current Image, and Yn^m, n) represents 
the (m, nyh pbcel value In the reference image, characters W and H represent the number of horizontal 
and vertical pbcels, respectively, and expressk>ns x_rang and y_rang represent a movement range of the 
current Image with respect to the reference image in the horizontal and vertical directions, respectively. 

17. AnrK)tion compensatkm encoding nriethod according to any of clainris 11 to 16, wherein step d)fur^ 
prises the sub-step of d2) generating the global motion vector on the basis of a nDean square error value 
according to pbcel difference values between a plurality of a respecth^ely moved cun^nt intage obtained 
by movement of the current inrtage within the predetermined nnotbn estimatton range and the reference 
image. 

1 8. A motion compensation encoding method according to daim 1 7, wherein saki sub-step d2) comprises the 
sub-step of da2) calculating the mean square error value of the pbcel difference values between one cur- 
rent image by movement using the following equation and the reference image. 
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in which Ycur(nn, n) represents the (m, ny»» pixel value In the current iniage, and Y^Km. n) represents 
the (m. nyh pixel value in the reference image, characters W and H represent the number of horizontal 
and vertical pixels, respectively, and expressions x_rang and y_rang represent a movement range of the 
current image with respect to the reference image in the horizontals and vertical directions, respectively. 
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FIG. 3 
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